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CLAIM LISTING 

This listing of claims will replace all prior versions and listings of claims in the application. 
Listing of Claims 

1. (Previously presented) An information tracker, comprising: 

a content analyzer comprising a memory for storing content data received from an 
information source and a processor for executing a set of machine-readable instructions for 
analyzing the content data according to query criteria; 

an input device communicatively connected to the content analyzer for permitting a user 
to interact with the content analyzer; and 

a display device communicatively connected to the content analyzer for displaying a 
result of analysis of the content data performed by the content analyzer; 

wherein, according to the set of machine-readable instructions, the processor of the 
content analyzer analyzes the content data to extract and index one or more stories related to the 
query criteria; and 

wherein a person spotting function of the machine-readable instructions extracts faces, 
speech, and text from the content data, makes a first match of known faces to the extracted feces, 
makes a second match of known voices to the extracted speech, scans the extracted text to make 
a third match to known names, and calculates a probability of a particular person being present in 
the content data based on the first, second, and third matches. 
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2. (Original) The information tracker of claim 1, wherein the processor of the content 
analyzer uses the query criteria to spot a subject in the content data, extract one or more stories 
from the content data, resolve and inference names in the extracted one or more stories, and 
display a link to the extracted one or more stories on the display device. 

3. (Previously presented) The information tracker of claim 2, wherein, in addition to 
displaying the link to the extracted one or more stories, the content analyzer displays one or more 
links to one or more shopping web-sites such that the user can purchase goods related to the 
subject. 

4. (Original) The information tracker of claim 2, wherein the names in the extracted stories 
are resolved and inferenced using an ontology. 

5. (Original) The information tracker of claim 2, wherein, if more than one story is 
extracted, the processor indexes the stories according to name, topic, and keyword. 

6". (Original) The information tracker of claim 5, wherein the stories are further ordered 
based on a causality relationship. 

7. (Original) The information tracker of claim 5, wherein the stories are further ordered 
based on a temporal relationship. 
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8. (Original) The information tracker of claim 1, wherein the query- criteria includes a 
request input by the user through the input device and the processor analyzes the content data 
according to the request. 

9. (Original) The information tracker of claim 8, wherein the content analyzer further 
comprises a user profile, which includes information about the user's interests, and the query 
criteria includes the user profile. 

10. (Original) The information tracker of claim 9, wherein the user profile is updated by 
integrating information in the request with existing information in the user profile. 

11. (Original) The information tracker of claim 8, wherein the content analyzer further 
comprises a knowledge base, which includes a plurality of known relationships, and the 
processor analyzes the content data according to the knowledge base. 

12. (Original) The information tracker of claim 11, wherein one type of the known 
relationships is a map of a known face to a name. 

13. (Original) The information tracker of claim 11, wherein one type of the known 
relationships is a map of a known voice to a name. 

14. (Original) The information tracker of claim 11, wherein one type of the known 
relationships is a map of a name to various related information. 
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15. (Original) The information tracker of claim 5, wherein the content analyzer further 
comprises: 

a user profile, which includes information about the user's interests; 
a knowledge base which includes a plurality of known relationships including a map of 
known faces and voices to names and other related information; and 

wherein the query criteria includes the user profile and the knowledge base. 

16. (Cancelled). 

17. (Original) The information tracker of claim 1, wherein the content data is a video signal. 

18. (Original) The information tracker of claim 17, wherein the information source is a cable 
television provider. 

19. (Original) The information tracker of claim 17, wherein the information source is a 
satellite television provider. 

20. (Original) The information tracker of claim 1, wherein the content data is an audio 
signal. 

21. (Original) The information tracker of claim 20, wherein the information source is a radio 
station. 
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22. (Original) The information tracker of claim 1, wherein the content analyzer is 
communicatively connected to a second information source for providing access to additional 
content data, the additional content data being analyzed for relevant stories. 

23. (Original) The information tracker of claim 22, wherein the additional content data is 
analyzed according to a first approach wherein terms are extracted from the query criteria and 
used to pose a search request of the second information source and a second approach wherein 
one or more sites provided by the second information are scanned for matching stories. 

24. (Previously presented) The information tracker of claim 23, wherein intersection stories 
are those matching stories which were retrieved as a result of both the first and second 
approaches. 

25. (Original) The information tracker of claim 22, wherein the relevant stories found in the 
additional content data are compared to find any intersection stories. 

26. (Previously presented) A method of retrieving information related to a targeted subject, 
the method comprising: 

receiving a video source from an information source into a memory of a content analyzer; 

analyzing the video source to recognize persons and extract stories from the video source 
using a query criteria, the query criteria comprising a user profile and a knowledge base stored in 
the content analyzer, wherein analyzing the video source comprises extracting faces, speech, and 
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text from the video source, making a first match of known faces to the extracted faces, making a 

second match of known voices to the extracted speech, scanning the extracted text to make a 

third match to known names, and calculating a probability of a particular person being present in 

the video source based on the first, second, and third matches; 

indexing the extracted stories according to temporal and causal relationships; and 

displaying indexed results of the analysis of the video source. 

So 

27. (Cancelled). 



28. (Original) The method of claim 26 wherein the analyzing of the video source to extract 
stories comprises segmenting the video source into visual, audio and textual components, fusing 
the information, segmenting and annotating the story internally, and inferencing the information. 

29. (Original) The method of claim 26, wherein the indexing of the extracted stories 
comprises indexing the extracted stories alphabetically. 

30. (Original) The method of claim 26, wherein the indexing of the extracted stories 
comprises indexing the extracted stories by topic. 

31. (Original) The method of claim 26, wherein the indexing of the extracted stories 
comprises indexing the extracted stories according to keywords matching the query criteria. 
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32. (Original) The method of claim 26, wherein the indexing of the extracted stories 
comprises extracting a causality relationship. 

33. (Original) The method of claim 26, wherein the indexing of the extracted stories 
comprises extracting a temporal relationship. 

34. (Previously presented) The method of claim 26, wherein the indexing of the extracted 
stories comprises indexing the extracted stories according to a pre-determined criteria, extracting 
a causality relationship, extracting a temporal relationship, calculating a rating for each of the 
extracted stories from one or more characteristics of the extracted stories, and prioritizing the 
extracted stories. 

35. (Original) The method of claim 34, further comprising creating a hyperlinked index to 
the extracted stories and storing the hyperlinked index. 

36. (Previously presented) A method of retrieving infonnation related to a targeted subject, 
the method comprising: 

receiving information from a user into a content analyzer, the information related to the 
user's interests; 

receiving first content data into the content analyzer; 

analyzing the first content data to extract a story relevant to the information received 
from the user, wherein analyzing the first content data comprises extracting faces, speech, and 
text from the first content data, making a first match of known faces to the extracted faces, 
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making a second match of known voices to the extracted speech, scanning the extracted text to 

make a third match to known names, and calculating a probability of a particular person being 

present in the first content data based on the first, second, and third matches; and 

displaying a link to the story so as to make the story accessible to the user. 

37. (Original) The method of claim 36, further comprising accessing second content data and 
searching the second content data for relevant information. 



38. (Original) The method of claim 36, wherein the content analyzer is centrally located and 
the user accesses the content analyzer via a communications network. 

39. (Previously presented) A information tracking retrieval system, comprising: 

a centrally located content analyzer in communication with a storage device, the content 
analyzer being accessible to a plurality of users and information sources via at least one 
communications network, and the content analyzer being programmed with a set of machine- 
readable instructions to: 

receive first content data into the content analyzer; 

receive a request from at least one of the users; 

analyze the first content data to extract one or more stories relevant to the request by 
extracting faces, speech, and text from the first content data, making a first match of known faces 
to the extracted faces, making a second match of known voices to the extracted speech, scanning 
the extracted text to make a third match to known names, and calculating a probability of a 
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particular person being present in the first content data based on the first, second, and third 

matches; and 

provide access to the one or more stories. 



- 10- 



PAGE 12/14 * RCVD AT 4/1 1/2006 2:56:02 PM [Eastem Daylight Time] * SVR:USPTO-EFXRF-2/21 * DNlS:2738300 * CSID:703 5199802 " DURATION (mm-ss):03-34 



